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ABSTRACT 

The effectiveness of self-instructional, 
performance-based modules used in teacher training programs is 
evaluated in this study. Criterion- referenced tests were used to 
determine the degree of achievement of the module objectives. Three 
classes of students enrolled in Designs for Teaching at the 
University of West Florida proirided the group of preservice teachers 
used in the study. Fourteen teachers enrolled in an off— campus course 
for teachers who were supervising student teachers made up the group 
of in-service teachers. A questionnaire was developed to elicit a 
reaction to the per forma nee- based module. Part 1 of the questionnaire 
determined the reaction to the content of instructional material, the 
instructional mode used, and the method of implementation. An 
11-point scale measuring like or dislike was provided. Part 2 of the 
questionnaire was designed to elicit response to the same items, 
using the same scale; however, a space was provided for a constructed 
response to the statement “Please explain why.” Part 1 was to be 
completed in class, and part 2 was to be completed out of class. The 
results of this study indicated that performance-based modules can be 
used effectively with both preservice and in-service teachers. A 
5-item bibliography and appendix with evaluation reports are 
included. (MJM) 



THE EFFECTIVENESS OF PERFORMANCE-BASED 
TRAINING MODULES 




ON 

PLANNING AND PRESENTING 



EOUCATION ft WELFARE 
rule ° FF,CE OF EOUCATION 
THIS OOCUMENT HAS BEEN REPRO- 
OUCEO EXACTLY AS RECEIVEO FROM 

ItiATiur^tT^ ° R ORGANIZAT ION ORIG- 

ON S N RT4Trn° nZ S l 0F V,EW 0R 0P 'N- 

IONS STATEO 00 NOT NECESSARILY 
REPRESENT OFFICIAL OFFICE OF EOU- 
CATION POSITION OR POLICY 



Faculty of Professional Education 
University of West Florida 
Pensacola, Florida 32504 



Jeff A. Pyatte 

Assistant Professor of Education 



AERA 1972 



r-- 

vs 

A 

ERLC 




. INTRODUCTION 



The concept of performance-based teacher education is receiving in- 
creasing attention by educational practitioners and theoreticians as well. 
According to a survey by the New Careers Development Center at New York 
University, sixteen states are developing means for performance-based 
certification. 1 The Florida Department of Education, for example, has 
taken the position that teacher certification should move toward the 
performance end of a continuum having non-performance criteria, such as 
personal traits, knowledge, and intelligence, at one end and demonstrated 
performance at the other. ^ While the status and the future of performance- 
based teacher education is uncertain, the potential impact of the movement 
is great enough to warrant careful and serious attention. Elam, for 
instance, has said that if teacher certification Is removed from successful, 
completion of a prescribed college curriculum and opened to anyone who can 
meet certain performance criteria, the impact on existing Inst I tutlons wM 1 
be enormous. 3 Although it is doubtful whether performance-based teacher 
certification would either be removed entirely from college curricula or 
whether non-performance Bases would be eliminated, the impact on existing, 
institutions would, In any case, be great. 

If performance-based teacher education is to become a successful 
movement, the concept must be built so that a number of crucial problems 
can be solved. Two such problems are: 1) establishing the relationship 

between required teacher behaviors and resulting pupil learning, and 2) 
developing ways of measuring the effectiveness of training materials 
designed to develop competencies In teacher trainees. 

Under Its research and development program, the Florida Department 
of Education is attacking both of these problems, By the end of 1374, 
evidence will be available shov.'ing relationships between teacher competen- 
cies and pupil learning, and training materials will be available to help 
teachers develop specific competencies 

'A necessary part of any program to develop performance-based materials 
for training teachers is the development of evaluation models for measuring - 
the effectiveness of these materials. While the Florida research and 
development effort In the area of performance-based teacher training 
materials includes a review-evaluation-cataloging center, no design for 
measuring the effectiveness of training materials Is yet operational. 



1 

Education Recaps 10:6 March 1971, p. 8. 

Fred Daniel , "Performance-based Certification: Florida's Projected 

Program" (Tallahassee, Fla.: Florida Department of Education) , May 5, 



971 (memographed) , p. 1 

’Stanley Elam, A Resume of Performance-Based Teac her Education: What 
the Art? CAACTE PBTE Series: 



'Stanley 

1 s the State of 



p. 5. 



No. 1 -A) , March 1972, 



^There's a New School Coming, Third Annual Report of the Florida R 6 
Program (Tallahassee, Fla.: Florida Department of Education, Division of 

Elementary and Secondary Education) , January 13, 1972, p. 3. 
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ln fact, although the demand for them Is increasing, evaluation designs, 
arc not readily available from any source. 



THE PROBLEM 

Performance-based modules In a self-instructional format are becoming 
an Increasingly significant part of the Instructional component of teacher 
training programs in many institutions throughout the country. Several 
states are planning to base their teacher certification on demonstrated 
performance of specified competencies, so it is unlikely that training 
modules will soon decline in importance as a means of developing teaching 
competencies. Measurement of the effectiveness of performance-based 
teacher training modules is a task of utmost importance to the developer 
who must convince the user that they, too, perform. This study had two 
purposes, both related to the evaluation of self-instructional, perfor- 
mance-based modules used in teacher training programs. First, a simple 
evaluation design was used to determine the effectiveness of two modules 
used wl th preservice and inservlce teachers. Secondly, a quest ionnai re 
was used to determine whether these two groups of teachers reacted 
differently to the modules. 

MATERIALS, SUBJECTS AND PROCEDURES 
Materials 

Modules 



Two performance-based, seif-instructional packages, called modules, 
were used in this study. 5 Each module contained all the Information and 
directions required for the learner to achieve several observable, measur- 
able goals. A set of learning activities was used to develop the in- 
struction for each objective In a module. The set consisted of 1) ex- 
posure to the objective of the set, 2) practice with the concept In- 
volved, 3) feedback on the practice, 4) confirmation of feedback, 5) 
revldw of concept, and 6) evaluation. The evaluation for each set 
provided the basis for a criterion-referenced test item to be used on the 
posttest for the module. Criterion-referenced test Items for all of the 
objectives In a module constituted the posttest for that module. 

While the modules were self-instructional, they were not programmed. 
An attempt was made to find a style of writing that avoided both linear 
programming, which bores many prospective teachers, and the purely textual 
mode, which lacks an adequate instructional element. The style represents 
an effort to achieve a mode of sei f-lnstructlon that is less a program 
than the typical seif-instructional learning sequence but more a program 
than is the typical textbook. 

The two modules are companions In a package on TECHNIQUE OF INSTRUC- 
TION, GUIDE TO STUDENT PRESENTATIONS. PART i, "Preparing a Lesson Plan," 



c 

Originally there was only one module. On the basis of preliminary 
studies on effectiveness, the module was spilt for this study. 
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!s designed to teach the student how to develop a short (5-15 minute) 
lesson plan. From this module, the student learns to develop a plan 
which employs a teaching model and conforms to the organizational princi- 
ples of a standard outlining procedure, Sample plans prepared by students 
who have successfully Implemented them are included in the module, 

PART II, "Making a Presentation," Is designed to teach the student to 
make an effective presentation of his lesson plan, From this module, he 
learns the techniques of effective presentations, how to allay fears, and 
how to evaluate presentations, The concluding activity requires the 
student to make a presentation or his planned lesson to his colleagues who 
serve as a "laboratory" class, 

instruments 



Tests . Criterion-referenced tests were used to determine whether the 
objectives of the modules had been achieved by the students, One test was 
constructed for each module, Each test had one criterion-referenced Item 
for each instructional set for which a written Item was an appropriate 
test si tuation, The test for the module on preparing a plan had a total 
of fjfteen items, and the test for the module on making a presentation had 
four. Tests for both modules demanded knowledge of the concepts developed; 
thus the emphasis was on recall. 

Quest ionnaj re. To elicit a reaction to the performance-based modul es 
a. two-part questionnaire was used. Part I of the questionnaire was de- 
signed to determine the reaction to the following three items: l) the 

content of the Instructional material, 2) the Instructional mode used, 
and 3) the method of Implementation. For each Item, the student was 
directed to indicate whether he disliked or liked it by putting a check on 
an eleven point (-5 to +5) scale. He was further asked to check his 
reason for liking or disliking by putting one or more checks by a list of 
possible reasons. The list also provided, an opportunity for the student 
to Indicate reasons other than those given In the list. 

Part 2 of the questionnaire was designed to elicit a response to the 
same three I tems--content , mode of Instruction, and method of implementa- 
tion. The same scale was used as was used in the first part. Instead of 
providing a list of reasons from which the reasons for his choice were to 
be selected, however, a space was provided for a constructed response to 
the statement "Please explain why," Part.l of the questionnaire was 

designed to be completed In class, and part 2 was to be completed out of 
class. .. * 



Subjects 

Three classes of students enrolled In Designs for Teachings The 
University of West Florida provided the group of preservice teachers used 
In the evaluation study. Designs for Teaching Is taken by fourth-year 
prospective teachers during the quarter preceedlng student teaching, There 
were eleven students In one class, ten In the second class, and eleven in 
the third class for a total of thirty-two preservice teachers. Ordinarily, 
the students who take Designs will have had no previous teaching experience, 
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A few can be expected to haye had somc'limitcd teaching experience. Some 
will have taught In special summer recreational programs, some In 0011000 " 
tlon with other education courses, some In a special summer teaching pro- 
gram offered by the University, and some will have served as substitute 
teachers. Of the thirty-two preservice teachers, six had previously had 
such limited teaching experience, One had actually worked as a classroom 
teacher for a short time. 

Fourteen teachers enrolled in an off-campus course for teachers who 
were supervising student teachers made up the group of Inservice teachers. 
All of these had taught at least two years, and all were currently 
teaching. Although one of the Inservice teachers had taught twenty years, 
the majority had from three to five years of teaching experience. 



Procedures 



Evaluation Procedure 

A simple single-criterion evaluation design^ was used to determine 
the effectiveness of the two teacher-training modules. The design Is 
Intended only to yield a rough appraisal of effectiveness, While very 
useful, this appraisal should not be considered final, The greatest value 
of the evaluation design is in determining (l) whether the material 
being evaluated should be further revised and developed and (2) If a 
need for further development is indicated, where it is required. 

The design concept is illustrated in Figure 1, It consists of a 
pretest and an identical posttest administered to groups of learners who 
have been through a self- instructional learning sequence, 



CRITERION- 




LEARNING SESSION 




CRITERION- 


REFERENCED 




USING 




REFERENCED 


PRETEST 


SELF- INSTRUCTIONAL 


POSTTEST 




SEQUENCE 


(l dent leal 
to Prestest) 







Fig. 1. — Visual Illustration of Simple Single-Criterion Evaluation 
Design 



Data required for the appraisal of effectiveness ares 

N n the number of students participating in the 

instructional sequence. v 



^Charles B, Havens, Measuring the Effectiveness of Programmed In- 
struction (Pensacola, Florida: Naval Air Basic Training Command), chap, 

It, 1967. K 
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GROUP/HODE » the groups being compared /the modes of 

Instruction being used (in this case 
only on mode — sel f-lnst ructional 
through modules). 

PRETEST 

MEAN (Raw) » the mean of correct responses earned 

by students on the pretest. 



% CORRECT 

PRETEST a the percent of the total of possible 

responses represented by the mean of 
correct responses on the pretest. 

POSTTEST 

MEAN (Raw) a the mean of correct responses earned 

by students on the posttest. 



% CORRECT 

POSTTEST a the percent of the total of possible 

responses represented by the mean of 
correct responses on the posttest. 



% GAIN/LOSS 

PRE/POST TESTS = the difference between the percent 

correct on the pretest and the percent 
correct on the post test. 



NO. ITEMS OM 

PRE/POST TESTS the number of items on the post test, 

(Since the pretest Is identical to 
the post test, there will be only one 
number. ) 

\ 

'tf the posttest consists of criterion-referenced test ‘Items taken 
from the instructional sets within the material, an Item-by-ltem produce 
tlvlty analysis can be done which will indicate which sets need revision 
or further development. 



Evaluation data produced for the design are reported In Part II of 
a MODULE EVALUATION REPORT form (see example on page 6), Space is pro- 
vided in Part II of the form for presenting data from comparisons of 
either two groups or two modes of Instruction. .. * 
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MODULE evaluat: 



Method of Implementation 



The teacher training modules on planning and presenting were used In 
the classroom under supervision by the classroom instructor. All students 
studied copies of the material at the same time and in approximately the 
same instructional sequence. Using a classroom supervised method of Im- 
plementation offered several advantages. It Is Important to note some of 
these, for the method is a departure from the completely sel ^instructional 
method. 

1. Use of the modules to develop elementary nomenclature, fundamental 
concepts, rules, and other repetitive kinds of presentations of 
factual Information freed the instructor to work with individual’s 
problems and to spend more time dealing with areas not easily 
covered in the module format.' 

2. instructional sessions controlled by the modules provided oppor- 
tunities for the Instructor to conduct group sessions as follow- 
up to the modules, to discuss special topics or problems, or as 
a recapitulation of facts and concepts. Such group activities 
allowed the Instructor to guide students to a deeper understanding 
of the objectives and permitted sufficient oral reaction to clear 
up vague or confusing points. 

3. Students were able to proceed at their own best rate of learning. 
Those who were slower could be assisted by the Instructor; those 
who were faster could be challenged to gain a broader and deeper 
understanding of the material. 

k. Students who completed the modules could be considered to have 
achieved approximately the same amount of learning. This made It 
much easier to proceed with other learning activities based on 
the concepts developed in the modules. 

Administration Procedures 

Both modules were administered in class under supervision, First, 
the package of two modules was Introduced as a set of self-instructional 
materials designed to develop skills In planning a lesson and making a 
presentation of that lesson. After the Introduction, a pretest for the 
module on planning was administered to every one In the class. Upon com- 
pleting the pretest, each student was started In the module on planning, 
the first of the two modules taken. At this time, the student was given 
a sheet for recording the date of all the days he worked cn the module, 
the beginning and ending time, and the total time In minutes spent on the 
module that day. During subsequent days, the student worked on the module 
when he had the time or when class time was set aside for such work, 

v 

Upon completing the first module, the posttest was administered. The 
pretest for the second module was then given, and the module, started. The 
student was Instructed to keep his time for that module also. After the 
second module had been completed and the posttest taken, the student was 
given the two-part questionnaire. He was told to complete part 1 of the 
questionnaire and return ft before leaving for that day. The second part 



he was told to complete at home and return it as soon as It had been com- 
pleted, 

The procedure for administering modules to both the preservice and 
the i nscrvice groups was the same. The preservice teachers, however, had 
ample time to complete the modules. The class of inscrvice teachers had 
only two periods of two hours, fifteen minutes each to complete both 
modules, Inservice teachers also had to complete both parts of the 
questionnaire in class, Because of restrictions on time, part 2 of the 
questionnaire from the inservice teachers had to be omitted. 

The modules were administered to the classes of preservice teachers 
as only a part of their total instructional activities. Classes met for 
one hour and twenty-five minutes two times a week for ten weeks. The 
longest Interval of time spent on the modules was five weeks. Much more 
time was available for additional Instruction for the classes of preservice 
teachers than was available for the inservice teachers. 



RESULTS 
Effect i veness 



Complete data for determining the effectiveness of the modules with 
preservice teachers were obtained from all thirty-two preservice teachers. 
Of fourteen Inservfce teachers, complete data for determining the effec- 
tiveness of the module on planning were obtained from nine, and for 
determining the effectiveness of the module on presenting, complete data 
were obtained from seven. 

The results of the evaluation procedure have been recorded in PART II 
of the MODULE EVALUATION REPORT form. Four completed copies of the form 
have been appended to this report. One for each of the two groups - pre- 
service and i nservlce teachers - and one for each of the two modules. The 
results of Part II have been summarized and can be found in Table 1, 
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Summary of the evaluation data from preservice and inservice teachers who completed the modules on 
planning and presenting. 
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ln a study of this kind some point must be established for deciding 
i when a module is effective. Strictly interpreted, the concept of perform 

mance based teacher training employs a pass-fail criterion and, therefore, 

| requires 100% achievement of objectives if instruction is to be considered 

1 effective. In most cases, however, this is unrealistic. Preliminary 

I evaluation studies on the effectiveness of the materials used in this study 

i had indicated that a mean of correct responses of about eighty percent was 

achievable. For the purposes of this study, then, a mean of correct 
j responses of eighty percent was established as the point for deciding 

I effectiveness. Assuming a zero starting point, not an unreasonalbe assump- 

tion when performance depends heavily on vocabulary as it did in the two 
| modules evaluated, the decision that a module is effective was made at the 

f point where percent gain from pretest to posttest reached eighty, 

i 

l Applying this criterion, the module on presenting, which yielded 85% 

i gain for preservice teachers and 80% gain for inservice teachers, was 

\ considered effective. The module on planning was deemed to be in need of 

j revision since its yielded gain was less than 80% in both groups. The 

j data clearly indicate that the majority of both groups achieved the objec- 

; tives of both modules - as they were measured by the criterion-referenced 

[ tests ♦ More than this must be demanded of performance-based instructional 

| materials, but just how much more is a debatable question. 

[ 

| Productivity data for the module on planning can be found in Table 2 

I and Table. 3. If the same criterion of eighty percent is applied to each 

I instructional set as was applied to an entire module and if that criterion 

Is required of both groups of teachers, only the sets tested by items 
f. number 1,2, 6, and 9 were not in need of revision. Therefore, extensive 

f revision of the planning module was indicated. The productive sets delt 

| with the teaching model, ways of motivating for learning, and ways of 

| evaluating learning. 
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Table 2 



Productivity of Sets for the Module on Planning foi* Thirty^two Preservice 
Teachers 



es t ! tem 
Number 


Pretest 


Post test 


% of Students 
Responding Correctly 
(Posttest Only) 


1 


15 


28 


88 


2 


1 


32 


100 


3 


1 


. 32 


1 00 


4 


2 


25 


78 


5 


0 


21 


66 


6 


1 


31 


97 


7 


0 


19 


59 


8 


0 


18 


56 


9 


1 


31 


97 


10 


0 


17 


53 


11 


3 


26 


81 


12 


0 


22 ; 


69 


13. 


0 


14 


44 


14 


6 


14 


44 


15 


22 


26 


81 




Table 3 



Productivity of Sets for the Module on planning for Fourteen Inscryice 
Teachers 



Test Item Pretest Posttest 9 % of Students 

Number Responding Correctly 

v (Posttest Only) 



1 

2 

3 

4 

5 

6 ' 

7 

8 
9 

10 

11 

12 

\ 

13 

14 

15 



1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

2 

6 



8 

9 

7 
6 

5 

8 

5 
4 
8 

4 

6 
3 
2 

5 

6 



89 

100 

78 

67 

56 

89 

56 

44 

89 

44 

67 

33 

22 

56 

67 



a F1ve inservice teachers failed to show up for posttest, 
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• Reactions 

Only one preserve ce teacher failed to respond to part 1 of the 
questionnaire designed to elicit reactions to the content of the instruc- 
tional material, the mode of instruction, and method of implementation. 
One other preservice teacher was given a faulty questionnaire, and his 
responses were not counted. All seven of the inservlce teachers who com- 
pleted the two modules returned part 1 of the questionnaire. 

On an eleven point scale (-5 to +5) of dislike to like, the reactions 
to content were very positive for both the preservice and the Jnservice 
groups. 

For the preservTce teachers there were; 

1 at -1 ; 

2 at 0; 

1 at +1 ; 

8 at +3; 

13 at +*»; 

5 at +5; 

and 0 at all other points. 

For the inservice teachers there were: 

2 at +3; 

2 at 

3 at +5; 

and 0 at all other points. 

The following array of choices of reasons was provided for the re- 
action to content. : 

Dislike 

' Too simple 

Too difficult " 

Confusing 

Dull HZZ 

Other 



Like 

Easy 

Clear 

Useful 

Other 



Preservice teachers checked clear and useful with about equal 
f requency (19 and 20, respect Ively) , whereas inservlce teachers* checked 
clear only half as frequently as they checked useful (3 and 6, respec-* 
t Ively). Six preservice responses and one Inservlce response indicated 
that some liked the content because It was easy. Responses in the "other" 
category were: different; gives definite suggestions for planning and 

teaching. 



l Z| 



Those preservice teachers who expressed a neutral feeling for a dis- 
like for the content did so because they considered it dull (1 response) 
or confusing (l response). The remaining preservice teacher who indicated 
a disi ike wrote "redundant" in the blank provided for "other" reasons. 

Reactions to the mode of instruction also were very positive. For 
the preservice teachers there were 

1 at -3; 

1 at 0; 

2 at +2; 

5 at +3; 

6 at +4; 

15 at +5; 

and 0 at all other points. 

For the inservice group there were: 

1 at +2; 

3 at +4; 

3 at +5; 

and 0 at all other points. 

The following array of choices of reasons was provided for the re- 
action to mode, of instruction. 

Dislike 

Too simple 

Too difficult 

Confusing 

Other 



Like 

Go at own rate 
Not too demanding 
Chal lengi ng 
Other 



The overwhelming choice of reason for liking the material was that 
It allowed students to go at thei r own rate (27 responses for preservice 
teachers; 6 for inservice teachers). Five preservice responses and two 
inservice responses v/ere recorded for like It because It Is not too 
demanding; three each for like It because it was challenging. 

* 

Feelings of dislike for the mode of instruction came from the pre- 
service teachers. One expressed the feeling that the mode was confusing, 
one that it was too mechanical and lasted too long. No one felt that the 
mode was either too simple or too difficult. , . v 

Reactions to method of implementation were more mixed than reactions 
to either content or mode of Instruction. For preservice teachers there 
we re: 
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1 at -5; • 

1 at -3; 

2 at -1 ; 

3 at 0; 

5 at +3; 

1 1 at +4 ; 

7 at +5; 

and 0 at all other points. 

For inservlce teachers there were: 

1 at -3; 

2 at +3; 

2 at +4; 

2 at +5; 

and 0 at all other points. 

The following array of choices of reasons was provided for the re- 
action to the method of implementation. 

Dislike 

Prefer to do outside class 
Not enough time allowed 
Other 



Like 

Definite time set aside 
Instructor available 
Other 



The reason most frequently given for liking the method of implemen- 
tation was the availability of an Instructor C21 responses for preservice 
teachers ; 5 for inservice). Fifteen and 2 responses, respectively, for 
preservice and inservlce teachers Indicated "definite time set aside" was 
the reason for liking the method. One preservice teacher liked the method 
because it was "flexible." 



Members of both groups who disliked the method did so because of a 
preference to do the work outside of class (5 responses for preservice 
teachers; 1 for inservice). Other negative responses were: classroom 

noise distracting, more time needed, and more discussion needed. 



None of the inservice teachers was able to complete part 2 of' the 
questionnaire. Twenty-seven preservice teachers returned part 2 completed. 
The consistency of their responses on the eleven point scale was remarkable. 
The average departure from the response to part 1 of the questinnalre was 
less than one scale division in the eleven. Only one student departed as 
much as four divisions, and most who departed at all were only one division 
away from their response to part 1. 



^ The constructed responses yielded very 1 ittle Information that was not 

SiSliftiS I °l the questionnaire. Two students called 
attention to the fact that too much emphasis on knowledge caused the con- 
tent to become boring. One expressed the feeling that the mode of 
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Ins true t Ion put the responsibility for learning where it belonged— on the 
student . But another f e 1 f that self-instruction "hand leads" too much. 

Regarding the method of implementation, notable comments were: 

Working in class was good because it provided opportunities to 
discuss things with classmates. 

More time should be used for discussion and less for content. 

Discussion wi th classmates was difficult because each was at a 
different place in the module. 

Extra time was required each class meeting to deal with materials, 
recording, reviewing, etc. 



SUMMARY OF FINDINGS 

1. Using 80% gain from pretest to posttest as a criterion for 
determining whether a module Is effective, "Preparing a Lesson 
Plan," the module on planning, was considered Ineffective, 

"Making a Presentation," the module on presenting, was considered 
effective. 

2. The effectiveness of the modules was unrelated to groups of 
teachers. What was effective with preservice teachers was also 
effective with inservice teachers; what was ineffective with one 
group was Ineffective with the other group. 

3. On the basis of part 1 of a two-part questionnaire, the reactions 
of both preservice and in service teachers to the modules was very 
favorable. 

4. No d{ scernable difference in the overall reactions of preservice 
teachers and inservice teachers was found to be supported by data 
from part 1 of the questionnaire. Both groups reacted favorably 
to the modules. 

5. Preservice teachers Indicated that they liked the content of the 
modules because It was both clear and useful, whereas Inservlce 
teachers Indicated that they liked it because It was useful, 

6. Both groups of teachers indicated that they liked the modei of 
instruction because It allowed them to progress at their own rate, 

7. Some members of both groups of teachers reacted strongly negative 
to the method of Implementation, Indicating that they would pre- 
fer to complete the modules out of class. Most teachers reacted 
favorably to method, however, Indicating that they . liked having 

a definite time to work when an Instructor was available. 
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DISCUSSION • ' 

Preliminary evaluation studies using the materials with preservice 
teachers only had indicated that both modules would be effective if an 
802 gain from pretest to posttest was required, To achieve this, it had 
been estimated, would take a mean time of about four hours for the two 
modules — which were only one when the preliminary studies were done. The 
mean time required for preservice teachers to complete both modules in 
this study was 279 minutes (see Appendix; MODULE EVALUATION REPORT), Pre- 
liminary estimates were close to correct, the difference very likely 
introduced as a consequence of splitting the original module. 

Ideally, the four and one-half hours available for the inservice 
teachers would have been ample time to complete both modules. Two 
sessions, however long, are not enough time to complete the work. Some 
time Is needed as a "break" during which time the learner can assimilate 
the material. Two one hour sessions per week for three weeks probably 
would be adequate. 

Reactions to the original module were favorable, as they were to both 
modules used in this study. The reasons for liking the material were very 
much the same in the preliminary studies as in this: clear, concrete, 

useful. The reasons for not liking the material were not the same in the 
preliminary studies. Not many of the preservice teachers expressed dislike 
for the original module, but those who did disliked it because it was 
undemanding. No one In this study expressed the feeling that the modules 
were undemanding. 

The results of this study Indicate that performance-based modules 
like the ones used can be used effectively with both preservice and in- 
service teachers. When used with inservice teachers, the utility of the 
concepts and skills should be emphasized. A mixed method of Implementa- 
tion, allowing some students to work outside class and others in class 
under supervision, should be used with both preservice and inservice 
teachers. 
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MODULE EVALUATION REPORT 



MODULE EVALUATION REPORT 



The form Is an adaptation of form CNABATRA 15^0111 (.11*66) used by 
the Naval Air Basic Traininq Command for reporting evaluations of pro- 
grammcd training materials ,* It is divided Into three parts, each of 
which has several subdivisions. 



PART 1 , THE MODULE 



1 . Title of Publication. 

2 . Author/ Institution . 

3. Date of Publication. 

4 . Type . 

5. Student Sample. 

6. Number of Pages. 

7 • Time Required to Complete the 
Module . 

' Minimum Time. 

% 

Mean Time. 

Maximum Time. 

8. Scope of Module . 



1 Charles B, 
(Pensacola, Fla.: 



Title as it appears on the module. 

Name of individual who is respon- 
sible for writing and revising 
module, institutional affiliation 
of author. 

Date that appears on module. 

Mode of instruction, eg,, pro- 
grammed, self-instructional, 
textual, etc. 

Total number of students who 
participated In the evaluation. 

Total number of pages in the module 



Time required for first student to 
complete the module. 

The mean (arithmetic) time re- 
quired for all students to complete 
the module. 

Time required for last student to 
complete the module. 

Summary of the objectives of the 
module. 



Havens, Measuring Effectiveness of Programmed instruction 
Naval Air Basic Training Command, CNABT P-771 PAT), p. 29 . 
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PART II. EVALUATION PROCEDURE AND DATA 



1 . Group/Mode. 

2 . N = Number of Students . 

N 

3* Pretest Mean (Raw) . 

k . Percent Correct . 

5. Posttest Mean (Raw) . 

6. Percent Correct . 

7 • Percent Gain Pre to Posttest. 

8. Number of Items in Pre/Posttests. 

PART III. METHOD OF 

l . Individual Study. 

2 . Collateral Study. 

3. In Class Study . 
k . Other . 

Part III is reserved for notes, comments 
mentation of the module. 



Modes of instruction when com-' 
parisons are made, eg,, self-ln- 
structional vs. lecture. 

Number of students used. Number 
in each group when comparative 
studies are made. 

Arithmetic average of the raw 
scores obtained by students on 
the pretest. 

Percent mean score is of total 
number of items on the pre/post- 
tests. 

Arithmetic average of the raw 
scores obtained by students on 
the posttest. 

Percent mean score is of the total 
number of items on the pre/post- 
tests . 

Difference of percent correct for 
posttest and percent correct for 
pretest. 

Number of items on test, (identi- 
cal test items in the same sequence 
must be used on both pre and post- 
tests.) 



IMPLEMENTATION 



Individual, out-of-class study 
(unsupervised). 

Individual , out-of-clas.s assigned 
study; homewo rk (uns upe rv i sed) . 

Individual study in class under 
supervision. v 

Mixed or other methods, 
and action resulting from imple- 



